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We study the conditions for the unique response in a class of nonlinear 
control syste7ns subject to random inputs using statistical linearization 
approximation. As in the case of sinusoidal inputs, voe show that jump 
phenomena may occur if the inverse vector locus of the linear part passes 
through certain regions on the complex plane, where the regions are defined 
by the characteristics of nonlinear part. Such jump phenomena regions 
for several typical nonlinearities are given; we also show that, among a 
restricted class of nonlinearities, the saturation and dead zone produce 
the largest jump phenomena regions. 

A new result concerning the validity of statistical linearization approxi- 
mation of nonlinear control systems is also presented. We show that the 
condition for the uniqueness of response to a given input in a nonlinear 
feedback system obtained through statistical linearization approximation 
is compatible with a related rigorous result, thus providing additional 
confidence in the applicability of statistical linearization. 

I. INTRODUCTION 

It is well known that jump resonance can occur in nonlinear con- 
trol systems with attendant worsening of the control performance. 
In the case of periodic input signals, the rigorous conditions for the 
unique response,* or equivalently, for the absence of jump resonance, 
are available. 1 In addition, various authors have studied the conditions 
for the absence of jump resonance using the describing function 
method (see Refs. 2 and 3) ; the describing function method criteria 



* Although the present terminology is widely used, a more precise term will 
be "unique solution to the equations arising from the steady state situation for 

o rrnmn inniti rnn MlO t irm " 



a given input realization.' 
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for jump resonance have been found for many common nonlinearities. 
For systems with random inputs, the exact condition for the unique 
response is not known, although a rigorous condition for the converg- 
ence of a successive approximation is available. 4 

A useful approximate technique for studying the performance of 
nonlinear feedback systems subject to random inputs is Booton's 
method of statistical linearization. 5 Although the method of statistical 
linearization has been widely used, the conditions for its validity are 
not fully known. 

The first part of this paper concerns the determination of the cri- 
teria for unique response, in a class of nonlinear control systems sub- 
ject to random inputs, using statistical linearization approximation. 
We present the statistical linearization criteria for unique response 
for several common nonlinearities. We also show that an idealized 
saturation and an idealized deadzone yield the limit jump phenomena 
regions among a restricted class of nonlinearities. 

In view of the uncertainty concerning the conditions for the validity 
of statistical linearization approximation, it is of interest to compare 
the results of statistical linearization analysis with those of a rigorous 
analysis. The second part of this paper presents a result that provides 
new evidence on the validity of statistical linearization approximation. 
More specifically, the conditions for the unique response obtained in 
the first part on the basis of statistical linearization are compared with 
a related result of Holtzman, 4 which is a rigorous sufficient condition 
for the convergence of a successive approximation starting with the 
statistical linearization approximation. We show that the two condi- 
tions are "compatible"; that is, the satisfaction of the rigorous condi- 
tion for the convergence of the successive approximation guarantees 
the satisfaction of the conditions for unique response based on sta- 
tistical linearization. However, since Holtzman's rigorous condition 
guarantees only the convergence of a specific successive approximation 
but not necessarily a unique reponse, while the conditions derived from 
statistical linearization are for the globally unique response, the pre- 
cise interpretation of the present comparison is largely open to debate. 
The present comparison lacks the finality of a similar comparison con- 
cerning the method of describing function in the case of periodic 
inputs. 6 Still, the comparison appears to provide some additional con- 
fidence in the validity of statistical linearization approximation. 

Section II defines the class of nonlinear control systems to be 
studied and derives the conditions for the unique response based on 
the statistical linearization analysis. Section III presents such condi- 
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tions for the unique response for several typical nonlinearities. Sec- 
tion IV shows that if the conditions for the unique response are met 
by saturation and deadzone nonlinearities, then a large class of other 
nonlinearities will also meet the conditions. Section V shows that the 
statistical linearization conditions for the unique response are com- 
patible with a related rigorous condition. 

II. CONDITIONS FOR THE UNIQUENESS OF RESPONSE 

Consider the nonlinear feedback system of Fig. 1. The nonlinear 
characteristic /(•) is assumed to be single-valued, odd, and piecewise 
continuously differentiable, and to satisfy 



0|a| f(m) ^ b 



(1) 



for all real m, where a and b are real. Concerning the linear element, it 
is assumed that: 

(i) G(ju) is the Fourier transform of a real function g satisfying 



/: 



(2) 
(3) 



0(0 I dt < co , 

(ii) 1 + h(a + b)G(jco) * 

for all co t ( — co , co ) , and 

(Hi) 1 + K.fi(ju) * (4) 

for all co e (- co, co ), where K tQ is the equivalent gain of the nonlinear 
characteristic /( ■ ) obtained by statistical linearization; that is, 

g[m/(m)] 
E|m 2 ] 



/v' - 



(5) 



In equation (5), E[-] denotes expectation taken over the probability 
distribution of m. The input r to the feedback system is assumed to be 
a zero-mean, stationary gaussian random function with the power 
spectral density given by ir?0,(w). 

We further assume that m can be represented by a zero-mean 
gaussian probability distribution. That m can be zero-mean follows 



f(- 



G(jcji 



Fig. 1 — Basic feedback system. 
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from /(•) being odd. This assumption is consistent with the usual one 
made in connection with a statistical linearization analysis of non- 
linear feedback systems. 5 

If the nonlinearity /(•) is replaced by the equivalent gain K eq , then 
the variance of ???• can easily be determined from 

'■ - s L it+ k.m) r dw - <6) 

From equation (6), it is seen that 
d 



d 



C,, 



(al | 1 + K.fl(j») | 2 ) > (7) 



for all co e ( — oo , co ) is sufficient to guarantee* 

3^ > for all tr r . (8) 

dcr m 

Condition (8) implies that a m is a monotonically increasing function 
of o T , which in turn implies that there is a unique value of a m given by 
equation (6) for a given <r r . This is the context in which the term 
"uniqueness" is used in this paper. Suppose that (da- T /d<r m ) < in a 
certain interval of the values of <r r . Then, the curve of a m versus <r r 
will have the shape given by either Fig. 2a or b. Figure 2a indicates 
nonunique <r m , and hence nonunique responses, or the presence of 
jump phenomena in the nonlinear feedback system of Fig. 1. Thus, the 
condition given by equation (7) is sufficient for the absence of jump 
phenomena in the system of Fig. 1. 

Rewriting equation (7) with H(jto) = G~ x {j<jj), Re H(ju>) = £ Q , and 
Im H(jui) = rj u , one obtains 

*■ + *" + ¥©' + <*>&& » 

Thus, inequality (7) is equivalent to the condition that the locus of 
H(jco) = G~ x ()<a), when plotted on the complex plane for co c (— oo, oo), 
remains outside of the circle centered at 

K +<^dK e( 



2 r/c 



,0 (10) 



and with radius 



* Inequality (7) may be considered to be necessary as well as sufficient for con- 
dition (8), in the sense that if the inequality is reversed in inequality (7), then there 
is at least one <f> r (u); for example, # r (w) = S(u — «'), such that condition (8) is violated 
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Fig. 2 — Curves of tr m versus <r r . 



P = 



<x m dK. t 
2 da m 



(11) 



The union of all such circles for all nonnegative real values of <r m gives 
a region on the H(ju>) -plane such that the sufficient condition (on the 
basis of statistical linearization) for unique response or for the absence 
of jump phenomena is that the locus of H(j<a) = G~ l (ju) remains outside 
of that region as w is varied on (— <*> , » ) . 

As in Ref. 3, the circles defined by equations (10) and (11) will 
be called the iso-o-,,, circles, and the union of all iso-o-„, circles for posi- 
tive a,,, will be referred to as the jump phenomena region. Both the 
iso-o»» circles and the jump phenomena region are determined by the 
characteristics of nonlinearity only. 

III. JUMP PHENOMENA REGIONS FOR TYPICAL NONLINEARITIES 

Centers and radii of iso-o-,,, circles for several typical nonlinearities 
are tabulated in Table I along with their normalized characteristics. 
Figure 3 shows the jump phenomena regions of these nonlinearities. 



IV. LIMIT JUMP PHENOMENA REGION 

Fukuma and Matsubara have shown that, using the describing 
function method for the system of Fig. 1 subject to sinusoidal inputs, 
the jump resonance regions for idealized saturation and idealized 
deadzone include the jump resonance regions for all other nonlineari- 
ties satisfying 

^ f(m) ^ 1, (12) 

in addition to being single-valued and odd. 3 The idealized saturation 
is given by 
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Table I — Characteristics of Nonlinearites 
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*IN ALL CASES CENTER IS GIVEN BY -X + JO, RADIUS IS GIVEN BY |p|, WHERE X= K-p. 
1 NORMALIZATION OF THE PARAMETER VALUES OF NONLINEAR CHARACTERISTIC USED IN 
FIGURE 3. 
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Fig. 3 — Jump phenomena regions: (a) relay, (b) relay with deadzone, (c) 
saturation, (d) saturation with deadzone, (e) deadzone, (f) j(m) — m 2 sgn(m), 
and (g) f(m) = m s . 
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Km) = 



—a; m < —a, 

m; —a ^ m ^ -\-<x, 

.+«; ~\-oc < m, 
and the idealized deadzone is given by 

; m < -0, 



(13) 



Km) = 



m 





Ira — 



(14) 



-0 ^ m ^ +0, 
+0 < in, 

where a and /? are positive real constants. Such limit jump resonance 
regions are determined by finding the nonlinearity satisfying in- 
equality (12) which maximizes the radius of the circle given the co- 
ordinates of the center of the circle. 

In this section we show that the idealized saturation and idealized 
deadzone give a limit jump phenomena region also in the case of 
random inputs, if /(•) is restricted to those satisfying inequality (12). 

Notice that 

a m dK ea a r , r ,, x , T , 

Y-d^ = dv E[mKm)] - K «> 

where v = a* . From a theorem given in Ref. 7, (d/dv)E[mf(m)] = 
E[f(m)] + \E[mj"{m)\, where prime denotes differentiation with re- 
spect to the argument. Integrating the first term on the right by parts, 



E[f(m)] = K. Q . 



(15) 



These relations reduce to 



<r m dK fQ _ , 



., , _ = \E[mj"{m)\. 

If /(•) is such that /"(ra) is piecewise continuous, then the right 
side of the above equation may be integrated by parts to give 

f f^T " ~\ /l r{m)[v{m) + mp ' (m)] dm ■ (16) 

For the gaussian probability density function for p(m), 

mp'(m) = —-rpim). 



Therefore, equation (16) may be rewritten as 
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¥-k=\[M- i ) nm) * (m)dm - (l7) 

If f'(m) is only piecewise continuous (as in the case of saturation 
and deadzone given by equations (13) and (14), respectively) then 
j"{m) is not piecewise continuous, and the integration by parts used 
above to obtain equation (16) may not be valid in the ordinary sense. 
However, if the meaning of the integration 

E[mf"(m)] = I mp(m)1"(m) dm 

J -OB 

is extended, and is considered as an operation of a distribution /"(??i) 
on an infinitely smooth function mp{m), then a generalized integra- 
tion by parts can be used. 8 The use of integration by parts, in the 
generalized sense, does not change the result in the present case, and 
equation (17) remains valid. 
Now, combining equation (17) with equation (15), 

-(*•■ + 2 s f^) = "2 /_j(z + tyMPM dm. (18) 
Suppose that the coordinate of the center of the circle is fixed, that is, 

-(*-+¥fr)-- x - (,9) 

where X is a constant. Clearly from equation (18), ^ X ^ 1 for f(m) 
satisfying inequality (12). From equations (18) and (19), 

f" (m 2 + OfWpW dm = 2\a 2 m . (20) 

The nonlinearity that gives the limit jump phenomena region is 
found by determining f(m) such that it maximizes 



(21) 



a o ¥" " ^T* f (wj2 ~ ^V(m)vi.m) dm 

L (l(T m -O m I «'-=o 

subject to the constraints given by equations (12) and (20). 

By using Pontryagin's maximum principle the appendix shows that 
the solution of above optimization problem is given by an idealized 
saturation and an idealized deadzone, or the nonlinearities of the form 
of equations (13) and (14), respectively. In other words, the idealized 
saturation and idealized deadzone yield the limit jump phenomena 
regions among all nonlinearities which are single-valued and odd, and 
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satisfy ^ f( m ) 3a 1| in the case of gaussian random input, as well 
as in the case of sinusoidal input. 

Suppose that the unit of the signals r, m, and so on, is normalized 
such that a m is taken as the unit. Then the appendix also shows that the 
jump phenomena circles giving the maximum radius are centered at 
( — Xi , 0) for the idealized saturation with a = 1 in equation (13) and 
at ( — X 2 , 0) for the idealized deadzone with /3 = 1 in equation (14), 
where 



(22) 
(23) 



In both cases, the magnitude of the maximum radius is given by 

[/' e ~ y/2y ~ 1/2 dy ~ f e ~ 7/ V /2 dy\ ■ (24) 



1 
p " 2(2*-)* 



The values of the integrals in equations (22) through (24) are tabu- 
lated in Ref. 9; it is found that 

X, - 0.44072, X 2 = 0.55928, p = 0.24197. 

V. COMPATIBILITY OF CONDITIONS 

In this section, we compare inequality (7), which is an approximate 
condition for the uniqueness of response or the absence of jump phe- 
nomenon based on statistical linearization, with a related rigorous 
condition to obtain further evidence concerning the validity of sta- 
tistical linearization approximation. Section II showed that inequality 
(7) implies the condition that the locus of H(jw) = G' y {j<ji) must remain 
outside of the circle denned by equation (10) and (11) on the complex 
plane as w is varied on (— °o, co). 

On the other hand, the rigorous sufficient condition for the conver- 
gence of a successive approximation is given in Ref. 4 as 



sup 

[(-0O.0O) 



G(p>) 



1 + *(a + b)G(jco) 



i(b-a)<l. (25) 



Inequality (25) implies that the locus of H(ju>) = l {jw) on the H(jai)- 
plane, as co is varied on (— °o, co), must not enter the circle centered at 

(-Ha + b], 0) (26) 
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with radius 

p = |(b - a). (27) 

The circle defined by equations (10) and (11) intersects the real axis 
of the complex plane at -K, Q and -[K eQ + <j m (dKJda m )] with its 
center lying on the real axis. Similarly, the circle denned by equations 
(26) and (27) intersects the real axis at -a and -b with its center 
also lying on the real axis. Thus it suffices to show 

a ^ K rQ + a m ~^ :g b, (28) 

and 

a ^ K eQ ^ b, (29) 

for all positive a m . 

But inequality (29) follows immediately from equations (15) and 
(1). Combining equations (17) and (18), 



K. Q + *„ 



da,,. 



= \ I" m 2 1'(m)p(m) dm. (30) 



From equations (1) and (30), a ^ K eQ + a m (dKJda m ) ^ j8, which is 
the inequality (28). 

Thus, inequalities (28) and (29) are satisfied for all a m > 0, which 
implies the two conditions are compatible; that is the satisfaction of 
condition (25) implies the satisfaction of condition (7) for all a m > 0, 
and conversely, the violation of condition (7) for some a m > im- 
plies the violation of condition (25) . 

VI. CONCLUDING REMARKS 

The conditions for the unique response in a randomly excited non- 
linear control system were studied using a statistical linearization ap- 
proximation. The jump phenomena regions of several common non- 
linearities were given. It was shown that, among nonlinearities satis- 
fying ^ f(m) ^ 1, the idealized saturation and idealized deadzone 
yield the limit jump phenomena regions. 

It was also shown that, concerning the uniqueness of the response 
in nonlinear feedback systems subject to random input, the criterion 
obtained by the statistical linearization approximation is not con- 
tradicted by a related, although not equivalent, rigorous result. How- 
ever, as mentioned in the introduction, the interpretation of this 
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result is largely open to debate since (i) the comparison made is be- 
tween an approximate and a rigorous sufficient condition, and (ii) 
the two sufficient conditions are not concerned with exactly the same 
requirement. More specifically, the approximate criterion obtained in 
Section II is for a globally unique response, while the rigorous result 
of Holtzman, with which the comparison is made, is for the conver- 
gence of a specific successive approximation. 

It is shown in Ref. 10 that, in a system closely related to that with 
which the present paper is concerned, there is a unique response up 
to an equivalence to an input r satisfying 



1 C T 
lim sup — / | r(f) \ 2 dt < «, 

T-too & J- J—T 



if the condition identical to condition (25) is satisfied. This result 
strongly suggests that condition (25) may be sufficient not only for 
the convergence of a specific successive approximation as shown in 
Ref. 4, but also for a globally unique response (up to an equivalence) . 
If this is true, then the meaning of the result of comparison made in 
the present paper is correspondingly strengthened. 

It is interesting to compare the limit jump phenomena regions of 
the present approximate analysis (Fig. 3c and e) with the circle of 
rigorous analysis, and to notice that the limit jump phenomena re- 
gions occupy substantial portions of the interior of the circle of ex- 
act analysis. Also notice that in view of inequalities (25) and (29), 
the statistical linearization analysis of the system of Fig. 1 always 
has a solution under the conditions dicussed in Section II. 
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APPENDIX 

Optimization Problem 

The following optimization problem is stated in Section IV: Maxi- 
mize | p | , where 

1 t"° 
P = 2~s / ( m2 ~~ <rl)f'(m)p(m) dm, (31) 

by choosing /'(wi), — so < m < oo, satisfying the condition 
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S f(») ^ 1, (32) 

subject to the constraint 

(" (ra 2 + <7 2 )/'(m)p(m) dm = 2\a 2 m , (33) 

J -co 

where X is a given constant such that ^ X ^ 1 . This problem may be 
solved by making use of Pontryagin's maximum principle. 

Since both (ra 2 — <r 2 )p{m) and (ra 2 + <r 2 )p(m) are even functions of 
ra, it suffices to find /' (ra) for ra ^ 0, and to let f (— m) = /'(ra). Thus, 
the problem may be reformulated in the following way. Let 

i,(m) = (m 2 - <r 2 )p(ra)/'(ra), (34) 

x a (m) = (ra 2 + <r 2 )p(ra)/'(ra), (35) 

where £,(0) = z 2 (0) = 0. We want to minimize or maximize Zi(°o) sub- 
ject to rc 2 (°o) = Xtr, 2 , . Pontryagin's maximum principle may be used 
to the above reformulation. The Hamiltonian function is 

H = r/l (ra)(ra 2 - a 2 n )p(m)f(m) + g 2 (m)(m 2 + <r 2 Jp(m)f(m), (36) 

where #i(ra) and g 2 (m) are the adjoint variables. Clearly, g x {m) = 
g 2 (m) = 0. 

Suppose first that Xi(°°) is to be minimized. Then g t may be set as 
<7i = —1; and maximizing the resulting H with respect to /'(ra) satis- 
fying inequality (32), one obtains, 

j'{m) = h + \ sgn [-(ra 2 - O + f/ 2 (m 2 + c 2 )]. (37) 

It is easy to determine that 

-1 ^ fh ^ +1 (38) 

to satisfy the constraint x 2 (co) = Xo-^ . For the values of g 2 satisfying 
inequality (38), equation (37) and /' (ra) = /'(— m) give 

ra < h -J ^ m , 

! ~ gJ (39) 



/'(ra) - 



iBf)- 



as the one that minimizes .r ,(«). The actual value of {72 is determined 
from equation (33), or 



/; 



(ra 2 + <r 2 )p(w) dm = Xcr 2 m , (40) 

where a = (1 + <7a/l — fr) V« . 
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Proceeding similarly, the function f{m) which maximizes £i(°o) is 
j'im) = - 



11 } -iiri) 1 *-' 

1 + 92/ (41) 

> U "T g2 ) <T m , 

1 U + g 2 / 

where — 1 ^ g% ^ 1. The actual value of g 2 is found from equation (33), 
or 

r (m 2 + (^^(m) dm = X<r 2 m , (42) 

where = (1 — g 2 /l + g 2 ) i a m . 

The functions f(m) of equations (39) and (41) correspond to 
idealized saturation and idealized deadzone, respectively. Thus, among 
nonlinearities giving P < 0, /'(ra) of equation (39) yields the limit 
jump phenomena region, and among the ones giving p > 0, /'(m) of 
equation (41) yields the same. 

Having determined the functions /'(ra) that maximize | p J, it is 
also of interest to determine the actual values of maximum | p | and 
the location of the center of the corresponding circles on complex 
plane. In case of idealized saturation, the maximum of | p | cor- 
responds to the minimum of p, and 

1 f" 
p — ~ 2 / (m — <r 2 m)v( m ) dm, (43) 

<r m Jo 

where a is given following equation (40). We want to find the value of 
X, ^ X ^ 1, such that p above is further minimized, and to find that 
minimum value of p. Differentiating equation (43) with respect to X, 

§ = -W _,•)„(„)!. (44) 



But, from equation (40) , 



. . da cr 2 m ,._, 

P«hr = a , 2 - (45) 

aX a m + a 



Thus, equation (44) becomes 



dp 



d\ a' + a: 
For minimum p, a = <r m or g y = 0. Thus, 



(46) 



1 C m 
Pmia = ~" 2 / (m* — <rDv( m ) dm, (47) 

0"m •'0 
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and the corresponding value of A. is given by 

A, = -L f " (m 2 + *i)p(m) dm. (48) 

<Tm Jo 

In order to obtain the results which are independent of the particu- 
lar signals used, suppose that the idealized saturation being consid- 
ered is further normalized such that 



Km) = 



-1; m < -1, 

m; -1 £ m S 1, ( 49 ) 

1; 1 < m. 



The units of the signals are also normalized such that <r m is taken as 
the unit. With these normalizations, the integrals of equations (47) 
and (48) may be evaluated using the tables in Ref. 9 to obtain Xi = 
0.44072, p min = 0.24197. 

In a similar manner, for the normalized idealized deadzone given by 

f m + 1 ; m < — 1 , 

i(m) = ' ; -1 £ m £ 1, (50) 

m — 1; 1 < m, 

it is found that X 2 = 0.55928, p m „ = 0.24197. 
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